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ABSTRACT 


Transformations  of  the  classical  hypothesis  testing  problem  with 
continuous-time  observations  to  a  hypothesis  testing  problem  with  counting 
point  process  observations  are  considered.  A  general  forrri  for  the  random 
intensity  rate  (RIR)  which  can  accommodate  feedback  is  investigated  and  the 
optimal  solution  in  the  Neyman-Pearson  sense  is  specified.  An  analysis  of  the 
performance  of  the  corresponding  optimum  processor  is  studied. 


1.  Introduction 

In  [1]  and  [2]  we  considered  the  classical  hypothesis  testing  problem 

//o-  under  (AT,),  T,  is  a  Wiener  process, 

Wj:  under  Pj,  r,  is  a  Wiener  process, 

0 

where  A'— r<  T,  are  the  continuous-time  observations,  and  investigated 
transformations  of  this  test  into  the  hypothesis  testing  problem 

//q-  under  Fo.  (A^),  7,  is  a  DSPP  with  RIR  0<  r<  7, 

//,;  under?,,  W,),  isaDSPPwithRlR 


where  7,  are  the  counting  point  process  observations.  In  addition, 

several  subopiimum  detection  schemes  were  presented. 

The  aim  of  the  investigations  in  [1]  and  [21  was  to  find,  from  among  a  given  class  of 
codes,  the  RIR  X  as  a  functional  of  the  ‘‘information  bearing  process"  X  and  the  observations 
A.  /.e. , 


X,- A,a,A),  (3) 

such  that  we  attain  or  come  close  to  some  “optimum  properties". 

In  this  paper  we  extend  the  results  of  ll)  and  (21  by  finding,  from  the  class  of  o- 
admissible  codes,  the  Neyman-Pearson  optimum  RIR  X.  The  paper  is  organized  as  follows.  In 
section  11  we  consider  the  classical  ‘^input"  h)^pothesis  testing  problem  of  deciding  between  two 
absolutely  continuous  measures  P©  ®nd  Fj  (Pi«PoK  gi^cn  some  observation  process 
A-(A,,7,®7oK  7  In  the  sequel  the  corresponding  Radon-Nikodym  derivative,  denoted 

by  A  7,  will  be  called  the  input  likelihood  ratio.  We  also  consider  the  “output"  hypothesis  test¬ 
ing  problem  of  deciding  between  the  probability  measures  Fq  and  .Pj  given  the  counting  point 
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process  observations  A  — T.  The  corresponding  Radon-Nikodym  derivative 
will  be  called  the  output  likelihood  ratio.  Theorem  1  specifies  the  Neyman-Pearson  optimum 
RIR  (of  significance  level  ao)  for  detection  in  the  class  of  o-admissible  codes.  It  is  shown  that« 
if  the  causality  condition  on  X  is  dropped,  the  optimal  RIR  is  given  by 

X/  -  Mo  + 

for  all  r,  T,  where  b  is  constant  and  xio.iLi  is  the  characteristic  function  of  the  set  (0,£l. 

We  conjecture  that  if  X  is  nonanticipative  the  RIR  is  given  by  (for  more  details  see  section  II) 

(5) 

for  all  /,  0</^  r 

The  degradation  which  appears  in  the  output  detection  problem  by  using  the  optimum 
RIR  X  (introduced  by  the  counting  point  process  observations)  is  established  in  section  111. 
The  main  result  in  section  III  is  presented  in  Theorem  2.  It  relates  (see  also  Lemma  3)  the 
power  and  the  probability  of  false  alarm  of  a  very  general  hypothesis  testing  problem  when  its 
sample  space  is  not  directly  observable  (DSPP  observations)  to  the  same  parameters  a  and  ^ 
one  would  obtain  if  the  input  space  were  directly  observable. 

11.  The  Optimal  Random  Intensity  Rate  for  Detection 


Let  us  consider  the  “input'’  hypothesis  testing_problyn  of  deciding  between  two  absolutely 
continuous  probability  measures  Pq  and  Pj  (P|^«Po),  defined  on  the  measurable  space 
(n,P),  given  the_observation  process  A'-(A',,P,0Po).  T.  The  construction  of  the  proba¬ 

bility  measures  Pq  and  Pj  is  given  in  13],  The  corresponding  Neyman-Pearson  test  of 
significance  level  ao  is  completely  characterized  by  the  sufficient  statistic  7),  where  L  is 

the  associated  threshold  (4). 

Let  us  consider  the  “output"  hypothesis  testing  problem  of  deciding  between  the  probability 
measures  Pq  and  P\  given  the  observation  counting  point  process  A^-(A',,Po0P,),  0^  T. 
The  corresponding  Neyman-Person  test  of  significance  level  ao  is  completely  characterized  by 
Xjo£](Ar)  where  L  is  the  threshold  . 

Definition  1.  The  class  of  codes  satisfying  the  peak  and  average  power  constraint 


0^X,(A,N)<c 


''  7-Jo  ^ 


ds  ^  qc. 


for  all  /  and /,  0< r<  r  and /*0,1  and  constants  c  and  c€P^.  and  1  is  called  0- 

admissible. 

Definition  2.  The  coding  X*(X,(A,N),P,0P,),  T,  is  said  to  be  optimum  in  the  Seyman- 

Pearson  sense  of  significance  level  ao  if  over  the  class  of  o-admissible  codes  the  supremum 


supr 


is  achieved  for  all  a,  a  ^  ao.  i  e.,  the  coding  X  maximizes  the  power  among  all  Neyman- 
Pearson  tests. 

Remark.  The  optimal  RIR  X  in  the  Neyman-Pearson  sense  features  the  best  performance  for  ^ 
only  a  given  probability  of  false  alarm  oq.  Therefore  the  above  optimality  criterion  leads  in 
general  to  solutions  which  arc  “locally"  optimal.  In  other  words  for  each  oq  a  different  code  X  y  Codes 
might  be  obtained.  .nd/or 

iDlal  I  Special 


Due  to  analytical  difficulties  we  will  restrict  the  following  analysis  to  the  oase  where  A,  is 
measurable  with  respect  to  the  o-algebra  for  all  T. 

Theorem  1.  Tfw  RIR  X^iki^Fj^^F,)^  0^  T,  corresponding  to  the  (output  observation)  count¬ 
ing  point  process  N  is  optimum  in  the  Neyman-Pearson  sense  if  it  is  given  by 

k,(X ^N)  ^  ^  b'X[ox]^  T^’>  (8) 

where  ^-dA— ^ — )c,  for  all  /,  0<  T, 

^Vao 

A  proof  of  this  theorem  appears  in  [31. 

Remark.  The  above  theorem  implies  that,  under  the  Neyman-Pearson  optimality  criterion, 
feedback  does  not  increase  the  power  of  the  output  hypothesis  testing  problem.  This  result  is 
somewhat  similar  to  the  result  obtained  on  the  capacity  of  the  Poisson  type  channel  under  a 
peak  and  average  power  constraint  (see  also  [5]- [7]). 

Since 


1— a 


1  + 

pLo'^b 

for  all  s,  0<s^  T,  we  conclude  that  the  test  statistic  for  the  output  hypothesis  testing  problem 
is  given  by 


where 


1 + 

A,  -/  In - - 

•  ^ - 

1  + 

i— o  pLo^^b 


0  l  + 

1-/8 


1  + 

1-a  pLo^b 


For  the  case  where  A,  is  measurable  with  respect  to  the  <r-algebra  for  all 

/,  0^  T,  we  state  the  following 


.  4  - 


Conjecture  1.  The  RIR  X— T,  corresponding  to  the  (output  observation)  count- 
ing  point  process  N  is  optimum  in  the  Seyman-Pearson  sense  \f  it  is  given  by 

KfiX^N)  -*  /io  10.1^1  (A,),  (13) 

where  — )c^for  all  t^  T,  The  threshold  L  \Rj^^  R^  is  defined  by^ 

pVao 

P o(A,  ^  Lf)  ^  ttQ* 

Remark.  The  RIR  X  described  by  (13)  can  be  seen  as  the  causal  version  of  the  RIR  X  given 
by  (8). 

In  the  next  section  an  analysis  of  the  performance  of  the  optimum  detection  scheme  is 
presented.  It  is  shown  that  an  equivalent  form  of  (12)  can  be  given  that  allows  a  simple 
analysis  of  the  performance  of  the  above  optimum  detection  scheme. 


111.  Performance  Analysis  of  the  Optimal  Detection  Scheme 


The  performance  analysis  of  the  optimum  Neyman-Pearson  detector  (12)  is  greatly  simplified 
by  the  following; 

Lemma  1.  //  /3  >  a  and  X5  *  po+^  X^A  f)  for  every  5,  0$  T,  then^ 

(14) 

where  \j  is  a  nonincreasing  Borel  function  of  Nj. 

A  proof  of  this  lemma  based  on  the  abstract  Bayes  formula  [8]  is  given  in  (3). 

Since  Ay-  —  A7-(A^7)  is  a  nonincreasing  function,  the  Neyman-Pearson  test 


Ar 


>  L 

<  L 


(15) 


(where  L  is  the  threshold  of  the  output  test)  is  equivalent  to 

"r  {5  i  Z  (I6> 

(where  1  is  the  corresponding  new  threshold  of  the  output  test). 

Since  A  7-  is  a  nonincreasing  function  of  the  observations,  the  power  B  ^ttd  the  level  a  of 
the  output  hypothesis  testing  problem  with  counting  point  process  observations  can  be  reduced 
to 


/8-  ?i(Nr  < 
a  -  P^(Sr  <  /)  - 

A«0 


(17) 


^  Randomized  lesis  ire  not  considered  here  The  extension  to  randomized  tests  can  be  done  in  the  usual 
manner  (4). 


where  1  is  the  new  threshold. 

In  the  following,  with  straightforward  mathematics,  we  will  find  an  equivalent  expressions 
for  p  and  a.  Our  standing  assumption  is  that  the  observation  process  0^  7", 

is  a  doubly  stochastic  Poisson  process  (DSPP). 

Let  us  first  relate  the  power  p  and  the  probability  of  false  alarm  a  of  the  input  to  the 
power  p  and  probability  of  false  alarm  d  of  the  output.  We  can  give  the  following 

Lemma  2. 


-  1  ( (n  ft-4’  ^ )  1  ^  ^ 

/9  -  21 - Ti - exp[- (^0+^)7')  -  “  MoJexp(-^o7'))3. 

A-0  ^  ’  A-0  ^  ■ 


5-1 

A-O 


k\ 


(18) 


k\ 


txpl- (410^ b)T]  -  ^  —li^iQ^by  txpi- bT)  -  /Liolexp(-fto7')a. 


^-0 


Proof.  Both  p  and  d  can  be  obtained  with  some  easy  manipulations,  and  only  those  for  p  are 
presented. 


A:) 


A-O 


£  -^£i((Mo+*-Xio,ii(Z))*exp[-(Mo+*-Xio.il(2))7'll 
A-0  ^  • 


•  21 +  [(mo  +  ^>)*expt-(Mo+*)7'l  -  Moexp(-/ixo7')Hl  - /3)1 

A-0 


*  £ - Tf - exp[-(Mo+^)^l  -  '^^l(pio^b)^txp(-bT)  ~  ^^]txp(-fxoT)p.  □ 

Let  us  compare  the  pairs  {p^a)  and  (p,a)  in  the  limiting  case  /xo-0.  The  test  statistic  can  be 
easily  reduced  to 


j  .0  -  //, 

'"M  >  1  -  H..  <■’> 

The  power  and  the  probability  of  false  alarm  a  can  also  be  computed  directly: 

p  -  P^{N^~0)  -  +  (1  - 

5  -  £oWr-0)  -  +  (1  - 

Fig.  I  illustrates  graphically  the  results  that  we  might  expect  in  terms  of  the  receiver  operating 
characteristic  (ROC).  Since  p»p  implies  /3*1,  the  only  point  of  intersection  of  the  above 
curves  occurs  for  (a,/3)-(l,l). 

Another  useful  representation  for  d  and  p  is  given  in 
Lemma  3. 

^  -  1  —  £j  X|0.z.i(2), 

^  -  1  -  £||^  -exp(-noT)  -  ^ -{Uio+bVtxpi-bT)  -  Molexp(-Mo£)  xio.ti<2)) 

A  ^  •  A-0  ^  • 


*  By  abuse  of  notation. 


•  6. 


.t 


Fig.  1  The  receiver  operating  characteristic  (optimum  processor). 

Of  *  1  ~  ^0  Xlo./.](^K 

(li.  T )  ^  ^  (22) 

a  -  1  -  £o{^ — — expC-^oT")  “  ^  -  f[(^o+l>)''exp(-bT)  -  /xo*lexp(-Mo7')  xio.ii<Z>l, 

where  ^lo.ii^Z)  denotes  the  characteristic  function  of  the  set  lO,L]  on  the  real  line. 

Proof.  The  proof  can  be  easily  supplied.  □ 

If  we  define  the  function  10,1]  by 

Xop/'^O  -  L  -^Moexp(-Mn7') 

-  X  TT^fMo+^^^expl-Vto+i’)^)  -  Moexp(-/xo7'))xio,i)fC).  <23) 

*-o  "  • 

for  all  (,  {€/?+,  we  arrive  at  the  following  fundamental  result: 

Theorem  2.  The  optimum  detector  at  the  output  of  the  processor^  performs  a  randomized  test  given 
by 

(24) 

which  is  an  approximation  to  the  optimum  input  test  specified  by 

^lo./.i({)*  (25) 

for  all  £,  {€  /?^,  respectively.  The  limiting  case  where  can  easily  be  analyzed.  We  have 

*  See  ll)-|3)  for  the  definition  of  the  processor. 


(26) 


-  7  - 


Fig.  2  Representation  of  the  optimum  input  and  optimum  output  test, 
and  thus  the  test  statistic  is  given  by 

(1-  (27) 

for  all  The  results  obtained  are  depicted  in  Fig.2. 

The  decision  procedure  at  the  output  of  the  processor  is  strictly  suboptimal  when  com¬ 
pared  to  the  optimal  decision  procedure  at  the  input,  should  the  input  be  completely  observ¬ 
able.  This  is  true  since,  under  the  Neyman-Pearson  criterion,  any  randomized  test  will  not  per¬ 
form  as  well  as  the  corresponding  optimum  test  given  by  (25)  (9,  p.65l.  This  agrees  with  our 
intuitive  feeling  that  the  transformation  which  lakes  place  through  the  processor  (see  also 
Fig.2.1  in  (3])  affects  the  information. 

Remark.  The  randomized  test  K^pt  has  a  very  simple  probabilistic  interpretation.  According  to 
this  interpretation,  for  a  particular  value  of  the  input  likelihood  ratio  f,  with  probability  ({) 
we  decide  that  the  null-hypothesis  is  true  and  with  probability  1  —  ({)  we  decide  that  the 

alternative  is  true.  The  deviation  between  the  optimum  randomized  test  ^io.£)  and  the  ran¬ 
domized  test  Kppf  will  define  a  measure  for  evaluating  the  performance  of  the  processor. 

IV.  Conclusion 


In  this  paper  the  Neyman-Pearson  optimum  RIR  X  from  among  the  class  of  o-admissible  codes 
has  been  specified.  Since  the  problem  of  finding  the  ROC  even  for  simple  hypothesis  testing 
problems  is  known  to  be  analytically  intractable,  a  new  type  of  comparison  between  the 
optimum  and  a  suboptimum  processor  has  been  introduced.  In  particular,  the  output  Neyman- 
Pearson  test  compared  to  the  similar  lest  for  the  input  turns  out  to  be  a  randomized  test.  The 
latter  test  shows  us  to  what  degree  the  processor  specified  by  the  RIR  X  leads  to  a  loss  of 
“information".  This  loss  supports  our  intuitive  feeling  that  the  “stochastic  mapping"  describ¬ 
ing  the  processor  has  to  reduce  the  amount  of  “information"  available  at  its  input. 
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